Using a Panoramic Camera for 3D Head Tracking in an AR Environment
نویسندگان
چکیده
For Augmented Reality using a pair of transparent 3D glasses, a precise and fast method for head tracking is required, to determine the user’s position and direction of gaze in all six degrees of freedom. The methods currently available require expensive external sensors and have small working areas and/or other limitations. We propose a method that uses a panoramic camera that is mounted directly on the user’s head, combined with cheap, easily mountable passive artificial landmarks. The panoramic camera uses a paraboloid mirror, which allows for interesting algorithmic simplifications. The system has been tested both in simulation and in reality and shows promising results.
منابع مشابه
Video Arrays for Real-Time Tracking of Persons, Head and Face in an Intelligent Room
Real-time 3D person, head and face tracking are critically important for natural interactions among humans in an intelligent environment. Trackers based on multiple networked cameras estimate human positions and heights more accurately and robustly than single camera or binocular trackers. The goal of this paper is to first present a comparative evaluation of two types of 3D tracking systems, n...
متن کاملA distributed device diagnostics system utilizing augmented reality and 3D audio
Augmented Reality brings technology developed for virtual environments into the real world. This approach can be used to provide instructions for routine maintenance and error diagnostics of technical devices. The Rockwell Science Center is developing a system that utilizes Augmented Reality techniques to provide the user with a form of \X-Ray Vision" into real objects. The system can overlay 3...
متن کاملIncorporating environment models for improving vision-based tracking of people
This paper presents a method for real-time 3D human tracking based on the particle filter by incorporating environment models. We track a human head represented with its 3D position and orientation by integrating the multiple cues from a set of distributed sensors. In particular, the multi-viewpoint color and depth images obtained from distributed stereo camera systems and the 3D shape of an in...
متن کاملSimultaneous Tracking of Head Poses in a Panoramic View
In this paper we present an approach to simultaneously estimate gaze directions of multiple people in the view of a panoramic camera. Human faces are located and tracked using a probabilistic skin-color model and motion detection. Neural networks are used to estimate head poses of the detected faces. With this approach, it is possible to simultaneously track the locations of multiple people aro...
متن کاملAR Visualization of Thermal 3D Model by Hand-held Cameras
In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. ...
متن کامل